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"MEDICAL VIEWING SYSTEM AND METHOD FOR DETECTING AND ENHANQNG BOUNDARY 
STRUCTURES IN NOISY IMAGES" 

Description 

Field of the Invention 

The Invention relates to a medical viewing system for displaying a sequence of Images of a 
medical Intervention that comprises moving and/or positioning a tool with respect to a body or^an. 
The Invention also relates to a computer executable Image processing method to be used in said 
system. The Invention further relates to a medical examination apparatus coupled to such a system. 
The Invention finds for example Its application in the medical field of cardiology, for registering and 
enhancing thin objects of interest such as vessel walls In arteriograms. 

Background of the Invention 

A method to extract and track the position of a guide wire during endovascular interventions 
under x-ray fluoroscopy is already icnown from the publication entttJed "2-D Guide wire tracking during 
endovascular Interventions" by Shiriey A. 1^, Baert:, In "Medical Image Computing and Computer- 
Assisted Intervention" -MICCAI 2000, S. L Delp, A. M. DIGIoIa, B. Jaramaz (eds), vol. 1935 of Lecture 
Notes in Computer Science, Springer-Veriag, Beriln, 2000, pp. 727-734. This publication describes a 
method that can be used In low quality fluoroscopic images to estimate the position of the guide wire 
in world coordinates. A two-step procedure Is utilized to track the guWe-wIre In subsequent frames, in 
a first step, a rough estimate of the displacements of the guide wire Is obteined using a template 
matching procedure on a spline model. In a second step, the position of the guide-wire is optimized, 
by fitting the guide-wire to a feature Image In which line-like structures are enhanced. In this 
optimization step, the Influence of the scale at which the feature is calculated and the additional value 
of using directional information Is Investigated. The method Is applied both on the original and 
subtraction images. Using proper parameter settings, the guide-wire could be successfully tracked 
based on the original images. In 141 out of 146 frames fn^m 5 Image sequences. 

A method for extracting stents in medical images Is already known from the publication 
entltied "Defomiable Boundary Detection of Stents in Angiographic Images", by loannis Kompatsiarls 
etalll, in IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL.19, No. 6, JUNE 2000, pages 652-662. 
This document describes an image processing method for deformable boundary detection of medical 
tools, called stents, in angiographic images. A stent is a surgical stainless steel coil that is placed in 
the artsry In order to Improve blood circulation In regions where a stenosis has appeared- Assuming 
Initially a set of three-dimensional (3-D) models of stents and using perspective projection of various 
deformations of the 3-D model of the stent, a large set of two-dimensional (2-D) images of stents Is 
consb-ucted. These syntiietic Images are tiien used as a training set for deriving a multi-variate 
density estimate based on eigenspace decomposition and formulating a maximum-llkellhood 
estimation framework In order to reach an Initial rough estimate for automatic object recognition. 
Then, the silhouette of the detected stent Is refined using a 2-D active contour (snake) algorithm. 
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integrated wttti an iterative initialization teclinique, wliicli talces into consideration the geometry of the 
stent As disclosed In the cited publication, when a narrowing called stenosis is identified in a coronary 
artery of a patient, a procedure called angioplasty may be prescribed to improve blood flow to the 
heart muscle by opening the blockage. In recent years, angioplasty Increasingly employs a stent 

5 implantation technique. This stent implantation technique includes an operation of stent placement at 
the location of the detected stenosis in order to efficiently hold open the diseased vessel, as illustrated 
by figure 2 of the cited publication. Stent placement helps many patients to avoid emergency heart 
bypass surgery and/or heart attack (myocardial infraction). The stent, as illustrated by figure 1 of the 
dted publication, is a small, slotted, stainless steel tube cut by a precision laser for forming a coil. It is 

10 wrapped tightiy around a balloon attached to a monorail Introduced by way of a catheter and a guide- 
wire fonnlng a device called balloon-tipped catheter. This balloon-tipped catheter Is Introduced Into 
the artery through a small incision. Once in place, the balloon is inflated In order to expand the coll. 
Once expanded, the stent, which can be considered as a pemianent implant, acts like a scaffold 
keeping the arter/ wall open. This allows more blood flow to the heart muscle. 

15 Summary of the Invention 

The first dted publication by Shirley A, M. Baert, is focused on guide-wire extraction based on 
rough estimation using template matching followed by optimization based on threadlike istructure 
enhancement, which is not easy to directly perform in a noisy images. The second dted publication, 
by loannls Kompatslaris etallf, is focused on visibility of the stent after stent deployment. 

20 However, before introduction of the stent, the doctor encounters a first very drfficutt step, 

which consists in passing the stenosis for the first time with the guide-wire. This is one of the most 
difficult tasks the doctor must perform, because the passage the doctor has to steer through, which Is 
the stenosed part of the artery, is very rough, irregular and limited. Besides, the artery walls are 
mainly radio-transparent which may necessitate the use of contrast agent in order to visualize and 

25 localize the stenosed part of the artery. When used, contrast agent must be introduced only in very 
small quantity during very small time duration because it presents toxicity for the patient. So, using 
contrast agent provides an Improved visualization of the artery only during about a dozen of seconds. 
The doctor must take advantage of this short moment to push the guide-wire forward, with the 
disadvantage that, due to the contrast agent, he does not see said guide-wire any more. While the 

30 contrast agent is operating, the doctor only sees the artery. He anew sees the guide-wire when the 
contrast agent has been eliminated through the patient's vessel system, after a few moments. 

Indeed, this step of introdudng the guide-wire for the first time is a very difficult step, due to 
the bad condition of imaging. The doctor can only follow the intervention on a screen, since In this 
Intervention the rib cage of the patient is not open. The guide-wire for the angioplasty is generally 

35 introduced through an opening In the femoral artery and pushed through the arteries until the aortic 
cross. Beyond the artery cross, the guide-wire Is Introduced into the coronary tiiat has been 
diagnosed as suffering of a stenosis. Not only are the guide-wire and the stenosed artery wails 
observed In noisy fluoroscopic images, but also they show low radiographic contrast that makes 
evaluation of the guide wire motion very difficult Besides, during this first phase of the angioplasty 
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Intervention, the guide-wire Is moving with respect to the artery, the arter/ is moving under the 
Influence of the cardiac pulses, and said artery is seen on a l^aclcground tiiat is moving under the 
influence of patients breathing and heart treats. These movements make following the guide-wire 
introduction under fluoroscopic imaging still more difficuit to perform, i^oreover, these movements 
5 make 2S3omlng Inefficient because the object of interest may get out of the zoomed image frame. 

The method of the first cited publication by Shirley A. M. Baert Is of no help for localizing the 
guide-wire with respect to a stenc^ed part of the artery during the step of first introduction through 
said stenosed part, since this method estimates the position of the guide in world coordinates and 
does not provide means to suppress the drawback of the artery motion in the Images. The method of 

10 the second publication by loannis Kompatslaris etalil, is of no help for localizing the guide-wire during 
the step of first Introduction through the stenosed part of the artery since this method is only focused 
on visibility of the stent after stent deployment. 

Hence, at the difference with the cited prior arts, it Is an object of the present Invention to 
propose an imaging system having means to improve the visualization and localization of the guide 

15 wire with respect to the artery walls, In real time, based on the detection of the tip of the guide-wire 
and the registration of the images. This improved means may be used for Instance during the first 
Inten^entional step of guide wire introduction, when the guide wire is passed through the stenosed 
part of the ari^ery for the first time. This first interventional step of guide wire Introduction is very 
important^ because if the Interventional step that consists in introducing this guide-wire for the first 

20 time fails, then the following steps of stent positioning and deployment are no possible. The 

alternative to the angioplasty is a heavy intervention for bridging the stenosed {Dart of the artery. This 
heavy intervention comprises opening the rib cage of the patient, which leaves much more sequels 
tiian tiie angioplasty intervention. 

Acconding to the invention, these problems are solved by an imaging system having means to 

25 process guide-wire tip information for determining the posMon of all the points of the skeleton of the ' 
guide-wire tip, and means to further register the region of interest around said position and means to 
enhance the visibility of the artery walls and guide wire In said region of interest This system has 
means to display in real time the processed images during the angioplasty intervention for the doctor 
to correctiy follow this intervention. This viewing system has processing means comprising tip 

30 detection means, registering means, enhancing means and zooming means that permit of accurately 
visualtzing the guide wire with respect to the stenosed artery walls. It is also an object of the 
invention to provide such a system whose Image processing means is user-actuateble. 

Such a system is claimed in Claim 1 and in dependent Oaims. An image processing method 
to be used in the system, a program product to Implement the steps of this method and an 

35 e3^mlnation apparatus for helping visualization of interventions having such a system are further 
claimed. 

List of Drawings 

Embodiments of the invention are described hereaflsr in detail in reference to diagrammatic 
figures wherein: 
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FIG.1 Is a functional block diagram of the registration means of the imaging system; 
F1G.2A Illustrates the guide-wire tip and RG.2B the skeletonized gulde-vyrire tip; 
FIG3 Is a functional block diagram of the enhancement means of the imaging system; 
FIG.4 Is a functional block diagram of the general means of the Imaging system; 
5 FIG.5A, 5B, 5C Illustrate the steps of detenmining motion vectors In a ROI; 

FIG*6A and 6B Illustrate the step of introduction of the guide-wire tip in an artery; 
FIG.7 illustrates the step of overlaying live images and peri-Intervention images; 
FIG.8 is a funcUonal block diagram of a medical lamination apparatus using said system.. 
Description of Embodiments 
10 The invention relates to a viewing system, and to a computer executable Image processing 

method that Is used in the viewing system, for detecting, localizing, registering, enhancing and 
zooming structures in noisy images. The viewing system and the Image processing method of the 
invention are described hereafter in an example of application to the medical field of cardiology. In 
said application, the object of interest is an artery, which is observed during a medical Intervention 
15 called angioplasty. In a sequence of X-ray fluoroscopic images called angiograms. 

Referring to FIG.6A, the angioplasty is a medical intervention that usually comprises several 
stages for enlarging an artery at the location of a lesion called stenosis. In a preliminary stage, the 
practitioner tocalizes a stenosis 3 in a patients artery 4 as best as {possible in peri-interventional 
images. These images are obtained while using a contrast agent introduced in the artery in order to 
20 improve the image contrast and with a conventional dose of x-rays. The guide-wire may be already 
present, but has not yet been passed through the stenosed part of the artery. Then, the medical 
intervention is performed while imaged on a screen under fluoroscopy, Le. with small doses of x-rays. 
In order to minimize the time duration of the intervention, and the total dose of x-rays to the patient, 
the intervention must be performed as quickly as possible. Hence, the Images must be improved. 
25 After passing a thin guide-wire through arteries until the aortic cross and then towards the 

stenosed artery 4, using a catheter 9, the angioplasty includes a stage of introduction of said thin 
guide-wire 1 through the small lumen of the artery portion 3 at the location of the stenosis. 

After introduction of the guide-wire, the angioplasty comprises further steps, which are not 
illustrated, of: 

30 introduction of a monorail, which Is guided by said guide-wire, which has a first 

balloon wrapped around its extremity, without stent; and positioning said first balloon in the artery 
portion 3 at the stenosis location; 

inflation of this first balloon for expanding the narrow lumen 3 of the artery 4 at the 
location of the stenosis; then, removal of the first balloon with the first monorail; 

35 again using the thin guide-wire 1 for the introduction of a second monorail with a 

second balloon wrapped around Its extremity, and with a stent around said second balloon; and 
positioning said second balloon with the stent at the location of the stenosis in the previously 
expanded lumen of the artery 4; 
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Inflation of the second balloon In order to expand the coll forming the stent, which 
becomes the expanded stent embedded In the artery wall; and 

considering the expanded stent as a permanent Implant, removing the second balloon 
attached to the second monorail, the guide-wire 1 and catheter 9. 
5 The medical intervention called angioplasty is difficult to carry out. The difficulties arise 

because of badly contrasted medical images, where the guide-wire, balloon, stent and vessel walls are 
hardly distinguishable on a noisy baclcground due to the feeble dose of x-rays In fluoroscopy, and are 
moreover submitted to motions due to the patientfs breathing and heart beatings. Some phases of 
this intervention are very critical. Particularly, the step of passing the guide-wire tip through the artery 

10 lumen at the location of the stenosis is very difficult for the doctor and critical for the patient. This is 
also a key step in angioplasty, since the other steps of angioplasty are not possible without said first 
step already performed. 

As illustrated by nG.2A, the guide-wire tip 2 Is a small metallic feature disposed at the 
extremity of the guide-wire 1. The guide-wire tip is not rigid, but is bendable in order to follow the 

15 shape of the artery. This guide-wire tip is about 1cm to several cm long and is thicker than the guide- 
wire. The guide-wire tip is very radio-opaque, compared to the artery walls and the guide-wire Jtself 
that are hardly distinguishable in the fluoroscopic images and that are difficult to visualtee when 
moving the guide wire forwards inside the artery. 

Hence, according to the Invention, it has been chosen to use the radio-opaque property of the 

20 guide-wire tip in order to localize thfe feature In a Region Of Interest ROI of the images. The system 
of the invention has means to detect the guide wire tip, to determine the position of all the points of 
the skeleton of the guide-wire tip, defined for example by co-ordinates x, y, as illustrated by RG.6B, 
In order to detemiine a field of motion vectors that Is used to register the Images with inspect to a 
reference image. The system has further means to enhance and zoom the threadlike structures 

25 formed by the guide-wire and the artery walls In the images. In the resulting sequence of Images, the 
contrast of the guide-wire and artery wails is improved, the motion is corrected, zooming may be used 
to enlarge these structures and the following of the intervention can be substantially continuous. 
Enhancing the features is of importance for the doctor, since at the beginning It is hardly possible to 
distinguish anything in the acquired images so that pushing the guide-wire forwards without visibility 

30 can disrupt the artery and arm the patient. Registering the Images In real time is also particularly 
Important for zooming. The Images can be further improved by superimposltion of stetic peri- 
Interventional views and live views. The system of the invention has means to perform all these 
operations. 

The user is the actor of the medical Intervention and can have the possibility to Intervene at 
35 each moment. Hrst of all, the user might choose a Region Of Interest ROI in the Images. Besides, the 
user has at his disposal control means 58, shown in RG.4 and RG.8, to activate and contral the 
Image processing means. These control means 58 comprises starting means, for the user to start the 
processing operation, to control the duration of the processing operation and to end the processing 
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operation. The processing means 10, 20, denoted by stenosis boosQng means, is actuated by the user 
control 58 during one of the above-cited phases. 

Referring to RG-l, the system of the invention has first Image processing means 10 for 
providing a field of motion vectors for estimating the motion of the guide-wire tip. The motion 

5 estimation Is perfonned in a first Region Of Interest ROI. The means 10 Includes a tip detector 11 that 
solves the problems of automatically detecting the guide-wire tip In the Images of the sequence 
displayed on the screen during the angioplasty. The tip detector provides a skeleton denoted by SiCT 
formed of a chain of pixels. The tip detector 11 may Include ridge filter for detecting ridge 
corresponding to the tip, threshold means to distinguish the tip from other features, pixel gathering 

10 means and connectivity analysis means to finally form a chain of pixels as illustrated by nG.2B. This 
tip detection is perfomied in all the images of the sequence. The skeleton is denoted by So in a first 
Image of the sequence to be considered, and Is denoted by St at a further Instant t. The skeleton 
detection pemiits of estimating the position of all the points of said skeleton of the guide wire tip In a 
referential of the images. 

15 An extension of the tip skeleton So-St in the succeeding images of the sequence is then 

performed by the skeleton extension means 12. This skeleton extension is peritormed spatially In each 
image separately. The spatial eftension may be performed linearly or according to a curve, In the 
forward and/or the backward directions. The skeleton may be spatially extended of a length D as 
shown In FIG.6B. Information data of the extended skeleton position are denoted by SVS't In the ROI. 

20 Infonnation date of the first extended skeleton position S'o is memorized In memory means MEI^. 

As illustrated by nG.5A, SB, using the information date of the first extended skeleton position 
S'o stored In MEM, skeleton vector field estimation means 13 compares the extended skeleton position 
S'o at a fiist instent t=0, in the referential of a first image called reference image, and In the ROI, with 
the extended skeleton positions S\ at succeeding instents t. This permits of estimating, as illustrated 

25 by HG.IC, a field of motion vectors V, which makes the extended skeleton positions S't correspond to 
the extended skeleton position S'o. Then a vector field extension is performed by the vector field 
estimation means 13, for instance using a known technique of warping. Using this technique, a 
geometric transform Is created. Then, said geometric transform is applied for performing a registration 
operation in the ROI. 

30 Referring to FIG.S, the system of the Invention further has second means 20 for enhancing 

threadlike features in the ROI in the Image sequence. The means 20 comprises registration means 21 
that receives the motion vectors V and the pixel intensity of the original Image I(t) and that registers 
the guide-wire tip in the different Images at Instents t with respect to tiie guide wire tip at the instent 
t=0 considered the referential of the reference image. Since the guide-wire tip moves together with 

35 the artery, said artery Is also registered with respect to the referential of the refermce Image and 
does move any longer from one image to a succeeding image of the sequence. Then, the means 20 
comprises ridge enhancement means 22 for enhancing the threadlike structures In the ROI. Hence, 
the threadlike structures constituted by the guide-wire and the ariiery walls are enhanced in the ROI. 
Then temporal Integration means 23 performs a temporal Integration. Said temporal integration can 
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be achieved by an averaging technique of the pbcel Intenstty of the registered threadlike structures 
over several Images for Instance while the background that Is still moving is blurred. The temporal 
Integration can be achieved by any other known technique. The means 20 further comprises dynamic 
adaptation means 24 for providing a resulting Image R(t) which may be zoomed according to the need 
5 or desire of the doctor. 

Now, the doctor has means to visualize the artery walls that are no more moving from one 
Image to a succeeding Image, that are no more Invisible but Instead that are enhanced. Referring to 
RG.4, the doctor has the means 58 to start the processing operation called Stenosis Boosting 10, 20. 
When started, the images pass from I(t) to Stenosis Boosting 10, 20. The data that are estimated for 

10 registering the ROI In the images, such as S'o, are memorized in MEM, and used for each Image 

registration. From the means 10, the position x,y of all the pixels of the skeleton of the guide-wire tip 
are estimated. Thus, the doctor can push slowly the guide fom^ard In the stenosed part of the artery, 
which is registered and enhanced on a blurred background. The start means 58 can start an 
automatic device 33 for delivering a small amount of contrast agent to be Introduced in the artery at 

15 appropriate Instant with respect to the Instants when the doctor push the guide forward while 
observing the processed Images R(t). The contrast agent is Introduced by appropriate means 
(catheter). In particular, a great advantage of the Invention Is that it is no more necessary to inject 
concentrated contrast agent In the artery of the patient Since the artery walls are enhanced, the 
doctor can see sufficiently the position of the artery wall to motion the guide-wire properly and safely. 

20 However, If the doctor wants to use a contrast agent. It is appropriate to use diluted contrast agent 
Instead of concentrated contrast agents which penults of visualizing the guide-wire tip while the * 
diluted contrast agent Is perfusing, which is not possible with concentrated contrast agent. Besides, 
diluted contrast agent Is less toxic for the patient than concentrated contrast agent. Using diluted 
contrast agent permits to use it on a longer laps of time without inconvenient for the patlenV thus a 

25 few minutes instead of a dozen of seconds with a concentrated contrast agent. The doctor may 
operate the start means as often as necessary, until the guide-wire tip Is safely passed through the 
stenosed part of the artery. 

In order to further improve the accuracy of the Images to be displayed by the display means 
for visualization by the doctor, a ROI can be superimposed to a con-esponding ROI of a peri- 

30 interventional image. Referring to RG.7, this operation can be performed using a block-matching 
technique. The data of the live image R(t) are entered together with date of a sequence of peri- 
interventional Images denoted by 3o to 3„ in a gray level based registration means 41. The gray level 
based registration means 41 can provide the current position of the guide-wire tip as shown In the live 
image R(t) superimposed on the features of the sequence Jo-Jn of peri-Interventlonal Images. The 

35 resulting combined features fonm a sequence of peri-interventlonal Images JVJ n denoted by OVERLAY 
1 that are enhanced by the features of R(t). Or, using an a-blending technique, the gray level based 
registration means 41 can provide a live Image denoted by R'(t), which Is an overlay, denoted by 
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OVERLAY 2, of a peri-fntBrventlonal image 3| among the set Jo-3n/ which is determined by the means 
41, superimposed on the live image R(t). 

Hence the system of ttie Invention Is able to provide live Images that are registered with 
respect to one another, resulting In live enhanced Images. This system Is also able to provide live 
5 Images that are registered with respect to perHntervenHonal Images. 

In a preliminary step, the peri-Interventional images can be registered one with respect to 
another In a referential formed by patient* s breathing characterlsb'cs and ECG points. Th«e peri- 
Interventional Images are then seen as a cloud of points In this referential. Hence, an Image I(t) would 
not be easily matched to one image of this set of peri-interventional Images. Now, according to the 

10 Invention, it is not the image I(t) that is proposed to be matched to one image of the set of peri- 
Interventional images, but instead it is the registered and enhanced Image R(t). Hence, a robust 
registration between the live and the peri-lnterventional images can be obtained. 

FIG.8 shows a diagram of a medical examination apparatus 50. The apparatus has means 51 
for acquiring digital image data of a sequence of Images, and is coupled to a medical viewing system 

15 53 as described above, for processing these data according to the processing method cited above. 
The medical viewing system Is generally used in the Intervention room or near the Intervention room 
for processing real time Images. Steps of the present method can be applied on stored peri- 
Interventional Images, for example for estimating medical parameters. The medical examination 
apparatus provides the Image data by connection 57 to the system 53. The system provides 

20 processed image data to display means and/or storage means. The display means 54 may be a 
screen. The storage means may be a memory of tiie system 53. Said storage means may be 
alternately external storage means. This Image viewing system 53 may comprise a suitebly 
programmed computer, or a special purpose processor having circuit means such as LUTs, Memories, 
Filters, Logic Operators, that are arranged to perform the functions of the method steps according to 

25 the Invention. The system 53 may also comprise a keyboard 55 and a mouse 56. Icones may be 
provided on the screen to be activated by mouse-cliclcs, or special pushbuttons may be provided on 
the system, to constitute control means 58 for the user to start, to control the duration or to stop the 
processing means of the system at chosen steges or phases. 
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CLAIMS 

1. A medical viewing system for displaying a sequence of medical Images that represents moving 
5 and/or positioning a guide-wire in a blood vessel, which guide-wire has a guide-wire tip that Is 

contrasted with respect to the guide wire, this system comprising acquisition means that acquires an 
original sequence of noisy Images called live sequence and processing means for processing said live 
sequence of images in real time, the processing means comprising: 

first means (10) for automatically detecting the guide-wire tip, yielding skeleton information of 
10 the guide-wire tip and a field of motion vectors based on said skeleton information; 

second means (20) for automatically registering the guide-wire tip with respect to a reference 
based on the field of motion vectors and for enhancing the guide-wire and the vessel walls while 
blurring the background in the registered images; and comprising: 

Display means for displaying a live sequence of processed images. 
15 2. The system of Claim 1, wherein the first means comprises means for spatially extending the 
skeleton, means for matching the current skeleton to a skeleton of reference, means to estimate the 
matching motion and means to extrapolate this motion tx> a full region of Interest (ROI). 

3. The system of one of Claims 1 or 2, wherein the computing means comprises: 

Selecting means for selecting a Region Of Interest in the sequence of images comprising the 
20 guide-wire tip, and processing the data in said Region Of Interest 

4. The system of Claim 3, having control means for a user to activate, to control the duration or 
to stop the processing means applied to the sequence of images in connection to a selected Instent of 
the sequence, comprising sterting means and stopping means for the user to activate or stop, at saki 
selected instant, the processing means applied to the sequence of images for improving the visibility 

25 of the selected Region Of Interest. 

5. The system of one of Claims 1 to 4, wherein the enhancing means comprises ridge 
enhancement means and temporal integration means for enhancing line-like structures and blurring 
the background. 

6. The system of one of Claims 1 to 5, wherein the enhancing means comprises: 
30 zooming means for zooming on the Region Of Interest. 

7. The system of one of Claims 1 to 6, wherein the display means comprises: 
registering means (41) for further registering a live sequence of processed images with 

respect to a sequence of corresponding images called peri-lntervenUonal, In order to form a new live 
sequence (R'(t)) on which the features of the peri-interventional Images are superimposed. 
35 8. The system of one of Claims 1 to 6, wherein the display means comprises: 

registering means (41) for further registering a live sequence of pixjcessed Images with 
respect to a sequence of con^ponding images called peri-lnterventional Images, In order to form a 
new sequence of peri-interventional images (3'0-J'n) on which the features of the live Images are 
superimposed* 
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9. The system of one of Claims 7 or 8/ wherein the peri- Interventional Images are first 
registered in a referential formed by two patients characteristics and the live processed images are 
further registered with respect to said first registered perl- Interventional images. 

10. The system of Claim 9, wherein the patients characteristics are a breathing characteristic and 
5 a heart pulse characteristic. 

11. A computer executable Image processing method to be used In a system as claimed in one of 
aaims 1 to 10. 

12. A device comprising a suitably programmed computer or a special purpose processor having 
circuit meanS; which are arranged to process images, to be used In a system as claimed in one of 

10 aaims 1 to 10. 

13. A computer program product comprising a set of instructions for carrying out an image 
processing to be used in a system as claimed In one of Claims 1 to 10. 

14. A medical examination imaging apparatus having means for acquiring a sequence of medical 
images and having a viewing system for processing and for displaying said sequence of images 

15 according to one of Claims 1 to 10. 
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ABSTRACT 

A medical viewing system for displaying a sequence of medical images that represents moving 
and/or positioning a guide*wlre In a blood vessel, which guide-wire has a guide-wire tip that is 
contrasted with respect to the guide wire, this system comprising acquisition means that acquires an 
5 original sequence of noisy Images called live sequence and processing means for processing said live 
sequence of images In real time, the processing means comprising: 

first means (10) for automatJcally detecting the guide-wire tip, yielding skeleton information of 
the guide-wire tip and a field of motion vectors based on said siceleton information; 

second means (20) for automatically registering the guide-wire tip with respect to a reference 
10 based on the field of motion vectors and for enhancing the guide-wire and the vessel walls while 
blurring the baclcground in the registered Images; and comprising: 

Display means for displaying a live sequence of processed images. 



15 



RG.1 



Image I(t) ) 



12^ 



Tip Detector 




Tip Skeleton 




Skeleton Extension 



S'fl 



-4 jviEIV! 



14 



Vector Reld Estimation 




Field of Motion Vectors 



S'o 



1(5 



21 



Registration 

— ^ — 

FIG.1 



1/5 




12" 



21 



Image I(t) 




Tip Detector 




Tip Skeleton 




S'o 



SIceleton Extension 



MEM 



14 



S'o-S't 



Vector Field Estimation 




Field of Motion Vectors 



Registration 




FIG.1 



RG^B 



PHFR020121 



2/5 



^^''"^ (^^^^^ectors Q mage I( Q 







r 


21 '^"^ Registration in ROI 




r 



No Motion in ROI 




— u '^'^g^ 



Enhancement 




Enlianced Stenosed Wall 



23 ^"-'-- P" Temporal Integration 



Enhanced Stenosed Wall 
+ 

Blurred Background 



24' 







• ^ Dynamic Adaptation 


1 


r 




Image R(t) 




F1G.3 



PHFR020121 




m. 



( [mage ^ 



Control M^ns 



Stenosis Boosting 




10,20 




Display Means 



Automatic Distribution 
of Diluted 
Contrast Agent 



FIG.4 




Gray Level 

Based 
Registration 



FIG.7 




INTERNATIONAL SEARCH REPORT 



7R-0 inMAY7nnR 



im 



>nal Application No 

PCT/IB 03/05051 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 606T5/50. A61B19/00 



According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classlfteatton symbols) 

IPC 7 606T A61B 



Documentation searched other than minimum documentation to the extent that such documents are Included In the fields searched 



Beclroi^c data base consulted during the International search (name of data base and. where practical, search terms Aised) 

EPO-Internal 



0. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



BAERT S A N; NIESSEN W J: "2D guide wire 
tracking during endovascular 
interventions" 

MICCAI 2002. 5TH .INTERNATIONAL CONFERENCE. 
PROCEEDINGS PART II, TOKYO, JAPAN, 25-28 
SEPT. 2002.- EDITED BY DOHI T, KIKINIS R 
AND PUBLISHED BY SPRINGER-VERLAG, BERLIN 
GERMANY, 2002, pages 101-108, XP0009025663 
page 101, paragraph 1 - page 105, 
paragraph ,1 

WO 01/031583 A (KONINKL PHILIPS 
ELECTRONICS NV) 3 May 2001 (2001-05-03) 
page 3, line 6 - page 7, line 11; figures 
2a-2d 



I- 3,5, 

II- 14 



I- 3,5, 

II- 14 



-/— 



m 



Further documents are listed In the continuation of box C. 



Patent tennliy members are listed In annex. 



" Special categories of dted documents : 

*A* document defining the genera) state of the art which Is not 
considered to be of particular relevance 

"E* earlier document but published on or after the International 
filing date 

"L" document which may throw doubts on priority clatm(s)or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 
other means 

"P" document published prior to the International fning date but 
later than the priority date claimed 



T* later document published after the International filing date 
or priority date and not In conflict with the application but 
cited to understand the principle or theory underiying the 
Invention 

"X* document of particular relevance; the claimed Invention 
cannot be considered novel or canrK>t be considered to 
Involve an Inventive step when the document Is taken alone 

*Y" document of particular relevance; the claimed Invention 

cannot be considered to Involve an inventive step when the 
document Is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
In the art 

document member of the same patent family 



Date of the actual completton of the International search 



13 February 2004 



Data of mailing of the intemattonal search report 

19/02/2004 



Name and mailing address of the ISA 

European Patent Office, P.B. 5818 Patentlaan 2 
NL-22aOHVRijswiik 
TeL (+31-70) 340-2040, Tx. 31 851 epo nl, 
Fax: (-i^l-rO) 340-3016 



Authorized officer 



Artlkis, T 



Fbrm PCT/1SA/&10 (second sheet) (July 1892) 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



onal Application No 

PCT/IB 03/05051 



C.(Cont{nuatlon) DOCUMEI^ CONSIDERED TO BE RELEVANT 



Category Citation of document, with Indicatton.where appropriate, of the relevant passages 



Relevant to daim No. 



P,A 



BAERT SAM; NIESSEN W J: "GUIDE WIRE 
TRACKING DURING ENDOVASCULAR 
INTERVENTIONS" 

MICCAI 2000. 3RD INTERNATIONAL CONFERENCE. 
PROCEEDINGS, PITTSBURGH, USA, 11-14 OCT. 
2000. EDITED BY DELP S L, DIGIOIA A M , 
JARAMAZ B AND PUBLISHED BY 
SPRINGER-VERLAG, BERLIN GERMANY, 2000, 
pages 727-734, XP0009025665 
page 727, paragraph 1 - page 731, 
paragraph 1 

AUFRICHTIG R ET AL: "X-RAY FLUOROSCOPY 
SPATIO-TEMPORAL FILTERING WITH OBOECT 
DETECTION" 

IEEE TRANSACTIONS ON MEDICAL IMAGING, IEEE 
INC. NEW YORK, US, 
vol. 14, no. 4, 

1 December 1995 (1995-12-01), pages 
733-746, XP000548591 
ISSN: 0278-0062 

page 733, left-hand column, paragraph 1 - 
page 737, left-hand column, paragraph 2 

WO 03/049032 A (FLORENT RAOUL ; LELONG 
PIERRE (NL); NOSJEAN LUCILE (NL); KONINKL 
PHILI) 12 Oune 2003 (2003-06-12) 
page 4, line 11 - page 7, line 10 
page 9, line 33 - page 12, line 17; 
figures la,3a-3c 



1-14 



1-14 



1-14 



fom PCTASASIO (eonUnuaUon of saoond eheot) (July 1882) 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 



3nal Application No 

PCT/IB 03/05051 



Patent document 
citad in search report 


Publication 
data 


Patent family 
meml}er(s) 


Publication 
date 


UO 0131583 


A 


03-05-2001 


WO 


0131583 Al 


03-05-2001 








EP 


1208537 Al 


29-05-2002 








OP 


2003513376 T 


08-04-2003 



WO 03049032 A- 12-06-2003 WO 03049032 A2 12-06-2003 



rami PCT/ISAAIO (patent tamly annex) (July 1892) 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

^□^R^FERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



